cd/entity/Rotary Positional Embeddings· home› entities› Rotary Positional Embeddings

grep -l @rotary positional embeddings /news/*.json | wc -l → 1

@Rotary Positional Embeddings

mentions 1 type Person feed RSS

00:00

2026-02-23

andlukyane.com

large-language-models

Beyond Positional Bias: How DroPE Unlocks Zero-Shot Long Context in LLMs

DroPE, a method that removes positional embeddings from pretrained large language models (LLMs) after training to enable zero-shot generalization to sequences far longer than their original training c…

// co-occurs with top 2 entities

DroPE 1 NoPE 1